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Abstract — The paper describes a framework for multi-function 
system testing. Multi-function system testing is considered as 
fusion (or revelation) of clique-like structures. The follow- 
ing sets are considered: (i) subsystems (system parts or 
units/components/modules), (ii) system functions and a subset of 
system components for each system function, and (iii) function 
clusters (some groups of system functions which are used jointly). 
Test procedures (as units testing) are used for each subsystem. 
The procedures lead to an ordinal result (states, colors) for 
each component, e.g., [1,2,3,4] (where 1 corresponds to 'out of 
service', 2 corresponds to 'major faults', 3 corresponds to 'minor 
faults', 4 corresponds to 'trouble free service'). Thus, for each 
system function a graph over corresponding system components 
is examined while taking into account ordinal estimates/colors of 
the components. Further, an integrated graph (i.e., colored graph) 
for each function cluster is considered (this graph integrates the 
graphs for corresponding system functions). For the integrated 
graph (for each function cluster) structure revelation problems 
are under examination (revelation of some subgraphs which can 
lead to system faults): (1) revelation of clique and quasi-clique 
(by vertices at level 1, 2, etc.; by edges/interconnection existence) 
and (2) dynamical problems (when vertex colors are functions 
of time) are studied as well: existence of a time interval when 
clique or quasi-clique can exist. Numerical examples illustrate 
the approach and problems. 

Index Terms — Systems engineering, Modular systems. System 
testing. Data fusion. Data streams. Graphs, Clique, Combinato- 
rial optimization 



I. Introduction 

In many contemporary complex systems, the significance of 
function system testing is increasing (e.g., iTjj, [241 ). In two 
recent decades, a central role of multi-function system testing 
has been pointed out in many studies (e.g., ||9l, 1241 . Il28l ). 
i.e., combinations of system functions can lead to general 
system faults. This situation is based on integration (fusion) 
of local faults into a general system faults. Here a local fault 
corresponds to a system unit/components and each local fault 
is a result of a certain system function. Often coordination of 
concurrent system functions can be organized at a insufficient 
level. In many recent well-known system faults (e.g., power 
stations, offshore drilling platforms, airplane crashes), coordi- 
nation among concurrent system functions was not OK (by 
computer systems, by maintenance documentations, etc.). In 
contemporary distributed complex systems, there exist many 
different users (they are not often coordinated), many different 
support teams (i.e., maintenance, management; they can be 
coordinated at insufficient level), and many different processes 
(they can be coordinated at insufficient level). Evidently, this 
kinds of applied situations for complex distributed systems 

Mark Sh. Levin: Inst, for Inform. Transmission Problems, Russian Acad, 
of Sci., Moscow 127994, Russia. Email: mslevin@acm.org. 



have to be examined via various approaches. Thus, a system 
analysis of combinations for concurrent system functions is a 
crucial direction in system testing {e.g., |i9J, [24\, |28|). 

In our paper, the above-mentioned type of apphed situations 
for complex distributed systems is considered and described 
(i.e., problem, models, solving scheme). Our framework is 
based on clique-based fusion of graph streams for multi- 
function system testing (f2T\, (23], f24\). 

Now let us consider a simplified example for a modular 
system consisting of the following components: basic facility 
si, control subsystem §2, safety subsystem S3, utilization 
personnel S4, maintenance/ testing personnel S5, and personnel 
for remote control sg. Three functions are examined (Fig. 
1): utilization function /i : {51,52,53,54}, maintenance/ 
testing function /2 : {51,52,53,55}, remote control function 
fs : {si, 52, sq}. In the case when a coordination between the 
above-mentioned concurrent functions is wrong, the following 
situation can be met; (i) basic facility 5i is out of service (by 
utilization personnel 54, i.e., via function /i); (ii) safety sub- 
system 53 is out of service (by an action of maintenance/testing 
personnel 55, i.e., via function /2); and (iii) control subsystem 
52 is under a wrong mode (by a wrong action of personnel 
for remote control 5g, i.e., via function /3). Fig. 1 depicts 
the examined situation (ordinal estimates of graph vertices are 
shown in circles; the following estimates for nodes are used: 
1 corresponds to a wrong mode, 2 corresponds to about 'OK', 
3 corresponds to 'OK'). 



Utilization 
function / 



Maintenance 
function /2 




Remote *i f 3 
control 
function 

Fig. 1. Illustration for simplified example 

As a result, a combination of interconnected system compo- 
nents (as clique) {51,52,53} will lead to a combined system 
fault. 

Our approach to system testing is based on a layered scheme 
(Fig. 2, adopted from |23| and |24|). Generally, the system 
testing framework consists of several stages as follows [22 1: 

Stage 1. Unit/component testing (e.g., |18|). 

Stage 2. Analysis of system functions, their interconnec- 
tions, and design of function clusters (functions which are 
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executed jointly/concurrently, i.e., at the same time moment) 

(HSU, CI). 

Stage 3. Design of an integrated graph over system compo- 
nents for each function cluster. 

Stage 4. Revelation of clique (or quasi-clique) in the inte- 
grated graph (e.g., jm, |l30J, LIJJ). 



Chains over system functions clusters 




(as scenarios) L ,L , . 








System functions clusters {Fi, .. 
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System components = {si, ... 


, 5^, 
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Fig. 2. Layered system testing scheme 

A simplified framework of the testing process is depicted 
in Fig. 3 (an integrated graph corresponds to function cluster 
F' — {fi, f^, fx}). Revelation of clique in the inte- 
grated graph is considered as a fusion problem or structure 
mining (e.g., llS), ifTSl ). Thus, our framework is based on 
revelation (mining) of cross-graphs cliques or quasi-cliques 
( ll24l . II3TI ). Many well-known traditional methods may be 
used for the analysis and revelation of cliques (or quasi-clique) 
in graphs (e.g., H], 112, ESI, m\, ED). 



f&n/,(G^^hD 



System 
function fi 

(Graph l) = 



Integrated 
graph G 



System 
function fx 

(Graph A) 



Revealed 
clique Q 

Fig. 3. Revelation of clique (quasi-clique) 



II. Preliminaries 

Here the basic sets are described ll24l . Let = 
{si, Si, Sn} be a set of subsystems or main system 
components. Let / = {/i, /t, /a} be a set of system 
functions. For each system function /c there is the following: 
(i) a subset of C that consists of components 

which are used for system function and (ii) a graph 

(usually a complete graph) over elements of f2(/c) as 

G(/e) = m),i?(/«)). 

There is a set of system function clusters F = 
{Fi, Fr, Fp} where Fr C /; each system function 
cluster Fr (r = l,p) is a subset of system function 
set F and for each system function cluster its elements 
(i.e., corresponding functions) are executed together at the 
same time moment. For each system function cluster Fr it is 
reasonable to examine the corresponding integrated graph as 



follows: G{Fr) = G{n{Fr),E{Fr)) = U/^g_F,.G(/j), where 
^(Fr) = ^f.epMfj) and E{Fr) = Uf^eF.E{fj). 

For each subsystem Si a system test procedure (as unit test) 
is used and the procedures lead to ordinal results (i.e., states, 
colors) for each system component, e.g., [1,2,3,4] (where 
1 corresponds to "out of service", 2 corresponds to "major 
faults", 3 corresponds to "minor faults", 4 corresponds to 
"trouble free service"). As a result, the graphs with ordinal 
weights of vertices (or colored graphs) are obtained. Finally, 
for each function cluster Fr we can examine the correspond- 
ing colored integrated graph G{Fr) = G{S{Fr), E{Fr)). 

In more complicated situation, the unit test results can be 
different for different system functions. Then the integration 
process is based on the following rule: in the case of difference 
of colors for the same vertex of graphs for different system 
functions (e.g., fj^ and fj^) the 'worst' color is selected. 

Let Qh be a clique over h vertices (e.g., Q4, here the 
estimate of each clique vertex is: < Z, I ~ 1,2,3,4), and 
"quasiness" or "approximation" (by number of vertices or by 
estimates of vertices) will be denoted by "widetilde" (e.g., Q/C)- 
Thus, in the integrated colored graph G{Fr) the following 
kinds of substructures (subgraphs) are under examination (by 
a rule: in the structure each vertex color " = 1", " < 2", 
etc.). Fig. 4 illustrates 4- vertex structure (ordinal estimates of 
graph vertices are pointed out in circles): 

1 . Clique, dimension of the clique equals (or more than) the 
number of functions in Fr (Fig. 4a): Qr ■ 

2. Quasi-clique by edges/interconnection (an edge is absent) 
(Fig. 4b): . 

3. Quasi-clique by vertices (in the revealed subgraph not all 
vertices have estimate < I, 1 — 1,2, ...) (Fig. 4c): Qr^ 

4. Quasi-clique by vertices and by edges (Fig. 4d): Qr or 

5. Sub-clique or clique with less dimension (i.e, the number 
of vertices in the clique v is less than the number of functions 
in Fr (Fig. 4e): Qv, v < p). 

6. Quasi sub-clique (structural approximation): (i) by ver- 
tices, (ii) by edges, (iii) by vertices and edges (Q, etc.). 





(a) clique Q4 




(b) quasi-cUque <i>4 

siCT 




(c) quasi-clique 
64 



(d) quasi-clique 
<I>4 or 04 

Fig. 4. Examples of clique and quasi-cliques 



■53| 

(e) sub-clique 

Q3 



It is reasonable to point out the following: 

I. A situation when the estimate of system components 
equals 1 (i.e., "out of service") is crucial and can lead to a 
system fault. This kind of situation is a "traditional" one in 
system testing. 

II. A situation when several interconnected (by time and/or 
system work) system components have estimates at a "medium 
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level" (e.g., "major fault" or "minor faults") can lead to a 
system fault in complex systems (e.g., |9|). Thus, our main 
efforts in this paper are targeted to this kind of a system 
situation (Fig. 5, here estimates of vertices are: < 3). On the 
other hand, the further examination can be mainly based for 
estimates of system components at the levels 1 and 2 because 
after a shift of the ordinal evaluation scale (i.e., [1,4]) this kind 
of mathematical problems will be obtained. 



S2 Si 





S4 5313 



(i) clique Q4 (ii) quasi-clique $4 
Fig. 5. Examples of system faults 

III. Basic Problem 

Here a basic problem (problem 7) is described. Structural 
fusion of quality estimates for system units/components upon 
ordinal scale is illustrated in Fig. 6, Fig. 7, and Fig. 8. 
The estimates for system components are depicted in Fig. 
6 (components S3, S5, and se- 1; component si: 2; and 
component 57: 3; other components: 4). The basic problem 
(Problem 7) is: 

Find for multi-function situation (in the integrated graph for 
function cluster Fr) clique Qh ( number of nodes equals the 
number of functions in cluster Fr or more with the estimate 
level <l (1 = 1,2, ...). 

Thus, the well-known clique problem is considered: 

Find the largest clique (complete subgraph) Q in an 
undirected graph. 



i Syst 



em 



HJCD QJ CD Qj QJ CD C£ 

si S2 S3 S4 S5 se S7 ss 
Fig. 6. System structure and estimates 




Fig. 7. Cluster of system functions 

The obtained set of system vertices/units has to be examined 
as "critical unit subset" or "system syndrome" (analogue of 
"syndrome" in medicine). In Fig. 6 and Fig. 7, F,. = 
{fi,f2,f3}- Further, in Fig. 8 the clique vertices are the 
following: {s3,S5,S6}. Here estimates of the vertices above 
equal 1. 



Clearly, the clique Q\ may be absent. In this case it may 
be important to search for quasi-clique Q\ or cliques which 
contain less number of vertices. 

Thus, another problem of structural fusion is (problem la): 

Find quasi-clique Q\ for the multi-function situation, i.e., 
without some interconnection/edges or/and with the estimate 
level: < I, (K I < 3). 

Examples of quasi-cliques (vertex sets) are the follow- 
ing (Fig. 8): (a) {si, S3, S5, se}, estimates: < 2; (b) 
{si, S3, S5, S67 S7}, estimates: < 3. Note, it may be often 
possible (and reasonable) to reveal several cliques (or quasi- 
cliques). 

S2 Function /2 

S4 




Revealed clique: 

Ql- {3,5,6} 



Fig. 8. Integrated graph for function cluster 

IV. Additional Problems 

A. Basic Sequences/Streams 

In the case of graph streams, an illustration is depicted in 
Fig. 9. 



Function z' „ti 
(stream v ? 



Function /i 
(stream 1) 



Function fx 
(stream A) 




iques 
(stream of 
cliques) 

Fig. 9. Revelation of clique over graph streams 
Here a time axis is considered as follows: 

t = {tq,Ti,T2,T3,T4,T5, ...}. 

As a result, the following is examined: 

(i) sequence of states for system components (j = 1, fc): 

s,(^) = {s;^sJ^sJ^sJ^sJ^sJ^...}, 

where s,(r^)e{0,l} (77 = 0, 1, 2, 3, 4, 5, ...), s^K) = 1 
if function j is used at time and Sj{T,i) = otherwise; 

(ii) sequence of system functions (^ = 1, A ): 

where Sj(t^) G {0, 1}, Sj(T,,) = 1 if function j is used at 
time and Sj{T,f) = otherwise); 

(iii) sequence of graphs for system functions (^ = 1, A ): 

(if sj'' = the corresponding graph G^^ is empty); 
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(iv) sequence of graphs for system function cluster (r = 
(if s. 



G(J.\ S n'''0 C'''^ /^"""S /^"""S /^''"4 /TTS \ 



„^ = the corresponding graph is empty). 

Here a chain of system function clusters (e.g., L =< 
F',F",F"' >) is considered as a scenario (in general, sce- 
nario can have a more comphcated type, e.g., tree, network). 



B. Other Problems 

The set of additional problems involves the following: 
Problem 2. Revelation of chque when the number of vertices 

is less than the number of functions in the function cluster (i.e., 

sub-clique). 

Problem 3. Dynamical problems (vertex colors are functions 
of time): 3.1. existence of a time interval where clique exists; 
3.2. existence of a time interval where quasi-clique exists. 

Problem 4. Analysis of time intervals when clique (or quasi- 
clique) exists and maintenance of the clique (quasi-clique) as 
some "critical" structure (substructure). As a result, a track for 
a special structure (e.g., clique Q) can be obtained: Tq. 

Problem 5. Design of actions as composite plans to destroy 
the critical substructure(s) (i.e., clique(s), quasi-clique(s)). 

V. Example 

Let us consider a numerical example. Table 1 and Table 2 
contain a description of the examined sets of system functions 
and function clusters: {/i, /2, /s, /4, /s} and {Fi,F2, Fs}. 

Table 1. System functions 



System 
function 


System components 




■'•■2 




•''■1 










/i 

/2 
/3 
/4 

h 


-k -k -k ★ 
★ ★ ★ * 

★ ★ ★ 



Table 2. System function clusters 



System function 
clusters 


System functions 


/i 


/2 


/3 


/4 


/5 


^1 

F2 

Fs 


■k -k -k 

■k -k -k 



The following time 

{T0,Tl,T2,r3,T4,T5} (i.e.. 



axis 



IS 



considered: 
0~5). The 



function cluster chain (a scenario) is as follows: 
L' =< F^°,Fl\Fl\Fl\Fl\F^'' > where upper 
index corresponds to time moment. Fig. 8 depicts integrated 
graph G{Fi), Fig. 10 depicts two integrated graphs: G{F2) 
and GiFs). 

Further, the following basic problems are under examina- 
tion: problem 3, problem 4, problem 5. Fig. 11 depicts state 
streams for system components (vertices) si, S2, ss, S4, S5, S5, 
se, sr, and while taking into account time axis above. In 



addition. Fig. 1 1 contains the following: (i) integrated graphs 
{G}, (ii) revealed structures (here: Q3), and (iii) obtained 
tracks of the revealed structures (here: Tq^). 



S2 51 Q 

S4 S5 





(a) integrated graph G(F2) (b) integrated graph G{Fs) 
Fig. 10. Integrated graphs for function clusters 

Now the following solutions can be pointed out: 

Problem 3.1. Clique Q3 : {33,35,3^} can be revealed for 
time: ri,r3,T4 (estimates of vertices equal 1). 

Problem 4. For time interval [ti , T5] there exists a structure 
with vertices: {3,5,6} while taking into account a well- 
known engineering "track initiation rule: 2 from 3" (i.e., 
for time interval with length 3 clique is revealed 2 times). 
As a result, it is reasonable to initiate at time moment rs 
clique Q3 ; {.S3,. 55,55} (estimates of vertices equal 1). 
Note, the rule above (the rules of these kind) is used as "track 
maintenance rule" as well. After that it is possible to maintain 
this structure (by the rule above) as an event (i.e., to check 
the initiation rule above at each discrete time moment, for 
example: T4, T5 ). 

Problem 5. Clearly, to destroy the event above (i.e., Tq^, 
Tq^, Tq^) it is necessary to destroy chque Q3 at time moment 
rs by improvement of state for S5 (or sq) (i.e., improvement 
of the estimate: 1 2 or 1 3 or 1^4). 



n-iTi 



g{f:^°) GiFp) g{f;^) G{F[' 



Si 

S2 

S3 
S4 
S5 

S6 



G{Fn G{f;') 

:3 



E 

E 
E 

E 



E 
E 

T 



Time axis 
I \- 



-+- 



-+- 



-+- 



-+- 



TQ Tl T2 T3 T4 T5 

Fig. 11. Example of graph streams 

VI. Generalized Testing Scheme 

A generalized testing scheme is presented in Fig. 12. Evi- 
dently, the generation of test inputs as sequences {sj{t),j = 
l,fc} can be based on two methods: (a) previous practice, 
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(b) special simulation approaches (e.g., Monte Carlo or quasi 
Monte Carlo methods jH]). 



Analysis and design of 
a system structure: 

Q = {si, Si, Sk} 



Analysis of system functions 
to get the function set 

{/l) •••) /C, fx} 



I 



Definition of function clusters 
{Fi, Fr, Fp} and basic 
function cluster chains 
(i.e., scenarios: {L}) 



Generation of test ^ 
inputs as sequences 
of states for system 
components 

{Sj{t),j^l,k} 



I 



System testing as evaluation 
of system work (for certain 
scenario): revealing the 
integrated graphs and 
corresponding clique-like 
structures and their tracks 



^Accumulation, processing 
of results and design of 
management action(s) (e.g., 
40 destroy some cliques) 

Fig. 12. Generalized testing scheme 

The suggested system testing framework can be used for 
system maintenance as well (Fig. 13): (1) evaluation of system 
components {sj}; (2) revelation of the executed system func- 
tion clusters (i.e., Fr); (3) revelation of integrated graphs, cor- 
responding "critical" clique-like structures, and the structure 
tracks; and (4) analysis and planning of system maintenance: 

(a) prediction: for system components and for whole system, 

(b) design of maintenance plan (e.g., improvement actions for 
system components). 



Revelation of executed 
system function cluster 

Fr 



Evaluation of system 
components (i.e., obtaining 

estimates for {sj}) 



Evaluation of system work: 
revealing of integrated graphs, 
corresponding "critical" 
structures and their tracks 



i i i 



Analysis of system and ^ 
planning of maintenance: 

(a) prediction (for components, 
for system), 

(b) design of maintenance plan^ 
(i.e., improvement actions) 



Fig. 13. Scheme of system maintenance 



VII. Conclusion 

In the paper, a new system framework for multi-function 
system testing has been suggested. The positive property of 
the framework consists in the following: concurrent system 
functions can be analyzed. The system framework is a basis 
for modification and adaptation. 

In general, it is reasonable to point out the significance 
of data stream systems (e.g., Q, JS), ll32l . Il34l ) which are 
widely used in many domains (data/knowledge summarization, 
image processing, system reliability analysis, initiation of 
target tracks in sensor systems, etc.). The key parameters 
for the systems above involve the following: (1) number of 
streams (one, many), (2) type of data, e.g., values (binary, 
ordinal, continuous), structures (i.e., preferences, graphs), (3) 
size of time window (i.e., number of series time moments 
which are jointly analyzed). A simplified typology of the 
systems may be considered as follows (e.g., IS), ifTSl . Il20l . 
1%!, (Tl], (32], {34]y. 

(a) static case for m streams: (i) summarization of values 
(binary, ordinal, continuous); processing methods: histograms, 
rule "fc of to", diagnosis techniques (e.g., closeness to centers 
of specified clusters) (e.g., [2J); (ii) aggregation of structures 
(e.g., m, M, Uni, ED, EOl, EI], ED); processing 
methods (e.g., decision making, knowledge engineering, image 
processing): building a maximum substructure (e.g., consen- 
sus, median), building a minimum superstructure; 

(b) dynamic case (one stream, window for n time moments); 
processing methods, for example: rule "k of to" (e.g., an en- 
gineering technique for initiation/maintenance of target tracks, 
analysis of system reliability, fusion of image sequences, 
revelation of patterns from time series of graphs) (e.g., [j3l, 

il, USD); and 

(c) combined dynamic case (to streams and window for n 
time moments); composite processing methods (e.g., dynamic 
decision making based on Markov decision processes or 
dynamic decision networks) (e.g., [|3l, B, fSl, (6\, ifTTl ). 

Three possible evident strategies can be used in case (c) 
above: 

strategy 1: (i) integration of data for each stream by a time 
window (case b), (ii) summarization of results for to streams 
(case a); 

strategy 2: (i) summarization of data of to streams at each 
time moment (case a); (ii) integration of results via a time 
window (case b); and 

strategy 3: combined scheme. 

Our suggested framework implements strategy 2 above: (i) 
fusion of graphs at each time moment with revelation of clique 
(or quasi-clique), and (ii) usage of rule "k of to". 

Note, our material has only a preliminary character as the 
first step and it is targeted to problem(s) formulation and 
solving scheme description (i.e., a new system framework). 
Next research efforts could include various investigations, 
for example: 1. study of the problems with some weights 
of system components or/and their faults; 2. exploration of 
cliques (quasi-cliques) as special kinds of composite events 
(as "generalized system syndromes") (to generate a set of 
possible composite systems faults); 3. study of stability issues 
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for considered solving schemes; and 4. design of a special 
simulation computer environment based on the suggested 
framework. 
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